Probabilistic model checking: formalisms and algorithms for discrete and real-time systems

This paper considers the problem of veriication of proba-bilistic systems, for both the discrete-and real-time cases. Probabilistic systems are modeled as Markov chains, concurrent Markov chains (i.e. MCs with non-determinism) or, in the real-time case, generalized semi-Markov processes (Markovian processes with time delays on events). Discrete-time speciications are described in the logics PTL (proposi-tional temporal logic), ETL (extended temporal logic) or PCTL (prob-abilistic full computation tree logic), or as B uchi automata. Real-time speciications are described either in TCTL (timed computation tree logic) or as deterministic timed Muller automata. The problems considered are either the probabilistic satisfaction of a speciication by a system (i.e., satisfaction with probability one) or the computation of the satisfaction probability. We give complexity results for the above problems and present some of the corresponding algorithms. Finally, we illustrate the approach with some examples.